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1 . (original) A method for tratisraitting a mixed media data stream in 
packets, including audio and video objects, between a sender and a receiver through a 
connection over a network, the method comprising: 

monitoring, at the receiver, transmission characteristics of the connection between 
the server and the receiver; 

estimating available bandwidth at the sender based upon the transmission 
characteristics of the connection monitored at the receiver; 

allocating a global buffer for the mixed media data stream to be transmitted fiora 
the sender to the receiver as a function of the estimated available bandwidth at the sender; 

pre-encoding a portion of each Video Object Plane (VOP) in the global buffer 
with respect to a quantization parameter (QP) of the VOP; 

encoding the VOP in the global buffer based on the QP; 

updating a rate distortion model based upon the QP and packet loss rate; 

performing a frame skipping function after the VOP encoding; and 

transmitting from the sender to the receiver the encoded video object plane in the 
global buffer at a regulated sender transmission rate from the sender as a function of the 
estimated available bandwidth at the sender. 
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2. (origina]) The method as defined in Claim 1 , further comprising: 
receiving the encoded video object plane at the receiver fi-om the connection; 



demultiplexing the encoded video object plane into coded video and audio 



streams; 
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inputting the coded video and audio streams, respectively, into video and audio 



decoders; 



inputting the decoded video and audio streams to a media mixer; and 
inputting the mixed video and audio streams output jfrom the media mixer to an 



output device. 



3. (original) The method as defined in Claim 1 , wherein pre-encoding a 
portion of each VOP with respect to the QP of the VOP further comprises adjusting the 
QPoftheVOP, 
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4. (original) The method a$ defined in Claim 3, wherein the QP of the 
VOP is adjusted with respect to a texture parameter, r, as the number of bits which will be 
used to encode the VOP wherein: 



X MAD X 



MAD 



QP 



QP' 



pj and p2 are control parameters; and 

MAD is a mean absolute distortion in which a total target bit rate for all objects i 
the global buffer are allocated proportionally to motion, size, and square of MAD. 



Lcc & Hayes, ixu; 
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5. (origmal) . The method as defined in Claim 4, wherein the adjusting of 
the QP of the VOP is perfomed by changing the QP to a values in a range from 1 to 31 



depending upon the estimated available bandwidth at the 



receiver. 



6. (original) The method as defined in Claim 1 , wherein updating a rate 
distortion model based upon the QP and packet loss rate comprises: 

predicting the number of bits, ri, to encode the ith VOP, and is given by; 



I 



ip.)xMAD. (j>^).xMAD. 

s — LJ -J- -|- 2 t I - 



the distortion, d, is estimated by 



= iq{>i X QP. + iq^), X QP^ + {q^)^ xr^x (P^), , wherein: 
qu qj and qs are control parameters; and 

the packet loss rate (Pl )i is an estimate of that the probability that the 
ith transmission of data from the sender will be lost; and 
minimizing the overall distortion, D» for each encoded VOP hy D = J^d. , subject 

Xo R^Y.r.<R^, where Rt is the total bit budget for the current time instant. 
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7. (originaJ) The method as defined in Claim 1 , wherdn: 
the sender sends data to the receiver in through a connection over a packet switched 
network in a sender packet having a sender header that includes: 
a packet sequence number; 

a timestamp indicating the time when the sender packet was sent (STl); and 
the size of tiic sender packet (PacketSi2e); 
the receiver sends data to the sender through the connection over the packet switched 
network in a receiver packet having a receiver header that includes: 

the time interval that the sender packet spent in the receiver side (dRT); 
the timestamp of the sender packet sent fiom the sender (STl); 
an estimate, calculated by the receiver, of a packet-loss rate; and 
the rate at which data is received at the receiver; 
monitoring transmission characteristics of the connection between server and receiver 



compnses: 



estimating a round trip time of the sender packet from the sender to the 
receiver (RTT) based on STl and ART; 

estimating a time out interval (TO) before which the sender should 
retransmit to the receiver a sender packet of data that has not been received 
by the receiver; 

estimating a probability that a packet of data will be lost (Pl); 

estimating the present available network bandwidth at which the 
receiver can receive data from the sender (rvcrate) as a function of the 
PacketSize, the RTT, the Pl, and the TO; 
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deriving the present sending rate of data from the sender to the receiver 
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(currate); 

setting an updated sending rate of data from the sender to the receiver 
(currate), vi^herein: 



if rcvrate is greater than currate , then deriving currate as a 



function currate , PacketSize, and RTT; and 



if rcvrate is not greater than currate , then setting currate to 



be less than rcvrate. 



8. (original) The method as defined in Claim 7, wherein: 



RTr^axR7T-i-(l-<z)x(now-STl-ART) ; and 
now is the timestamp indicating the time at which the receiver packet was 
received in the sender; and a is a weighting parameter. 



9- (original) The method as defined in Claim 7, wherein: 
TO = RTT^{k X RTTVAR) \ 

k is a constant; 



RTTVAR = ^2 X RTTVAR + (1 - ^2 ) x \RTT - {now ^ ST\ - Aff 7)1 ; 



RTTVAR is the current variation in the round trip time of the sender packet from 
the sender to the receiver (RTT); 

q2 is a weighting parameter, and 



RTTVAR is a smoothed estimate of RTTVAR . 
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1 0. (original) The method as defined in Claim 7, wherein Pl is derived 



by a Gilbert Model. 



1 1. (original) The method as defined in Claim 10, wherein: 
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p. = ^ 



L A A » 

Xi takes 1 if the ith sender packet has arrived successfully at the receiver, 
Xi takes 0 if the ith sender packet is lost; 



is an estimate of p- 



is an estimate of q; and 



P^^Qll^Q ^^ = «j0/«| , wherein: 



noi is the number of times in an observed time series when 



one 



follows zero; 



nio is the number of times when zero follows one; 
no is the number of zeros; and 



ni is the number of ones. 



8 



ZikK A HaTBS, PLur 



MS t-05S9US. pmanAnibrt 



PAGE 10119 ' RCVDAT 112712005 5:43:07 PM [Eastern Standard Time]* SVRiUSPTO-EFXRF-lfi' DNIS:g729306 ' CSID:509 323 8979 ' DURATION (in[n-ss):04-22 



JhM 27 2ms 15:03 FR LEE - HAYES PLL 



509 323 8979 TO 17Q3S72930& 



P- 11/19 



1 

2 

3 

4 

5 

6 

7 

8 



9 
10 
U 
12 
13 
14 
15 
\6 
17 
18 
19 

20 

21 

22 

23 

24 

25 



12. (original) The method as defined in Claim 1 1, wherein: 

the Pj^ is further smoothed by a filter that weights the n most recent 
measxired packet loss rates by: 



^ is the measured packet loss rate in the (i-j)th time interval; 
two set of weighting parameters are defined as follows: 
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Wl 


1 W2 


W3 


W4 


W5 


W6 


W7 


WSl 


1.0 


1.0 


1.0 


1.0 


0.8 


0.6 


0.4 


0.2 












WO 


Wl 


W2 


W3 


W4 


W5 


W6 




WS2 


1.2 


1.2 


1.0 


1.0 


0.8 


0.5 


0.3 


0.1 



; and WS2 is used for when the actual packet loss rate is less 
than half of the measured packet loss rate, otherwise WSl is used 
for Wj. 



13. (original) A computer-readable media comprising computer- 
executable instructions for performing the method as recited in Claim L 
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14* (original) A method for transmitting a mixed, media data stream in 
packets, including audio and multiple video objects (M VOs), between a sender and a 
receiver through a connection over a network, the method comprising: 

monitoring transmission characteristics of one or more encoded video object 
planes through the connection between the sender and the receiver; 

estimating, from the transmission characteristics, an available bandwidth (Rt) at 
the sender; 

J 

allocating, as a function of the Rt. a portion of the mixed media data stream to a 
global buffer; 

encoding a video object plane from the global buffer based upon a rate distortion 
function that accounts for packet loss rate betwe^i sender and receiver; 

updating the rate distortion function based upon results of the encoded video 
object plane and upon a memory containing results of one or more previously encoded 
video object planes; 

after the encoding the MVOs in the video object plane, performing a frame 
skipping function; and 

transmitting, at the estimated available bandwidth, the encoded video object plane 
from the sender to the receiver. 
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1 5. (original) The method as defined in Claim 1 4, wherein allocating a 
portion of the mixed media data stream to a global buffer comprises: 

^cur '''^^^^^^prev'^^prev^''^r/^old "^j/^"'^' 0) , as the global buffer 
size is changed to Rt/2, wherein: 



17 

IS 

19 

20 

21 

22 

23 

24 



Bprev is the number of bits spent in the previous time instant B 
Roid/2 is the previous size of the global buffer; 
Wprev is the previous occupancy of the global buffer; and 
F is the video frame rate. 



prevy 



1 6* (original) The method as defined in Claim 14, wherein allocating a 
portion of the mixed media data stream to a global buffer comprises the allocation of an 
output target rate from the global buffer among each of video and audio data streams so 
as to yield the target bits for an individual object in the data stream. 
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1 7. (original) The method as defined in Claim 1 4. further comprising; 
receiving the encoded video object plane at the receiver fi"om the connection- 



demultiplexing the encoded video object plane into coded video and audio 



streams; 



inputting the coded video and audio streams, respectively, into video and audio 



decoders; and 



inputting the decoded video and audio streams to a media mixer; and 
inputting the mixed video and audio streams output from the media mixer to an 



output dcAdce. 



1 8. (original) A computer-readable media comprising computer- 
executable instructions for pCTfomiing the method as recited in Claim 14, 



19- (canceled). 



20. (canceled). 



21. (canceled). 



22. (canceled). 



23. (canceled). 



24. (canceled). 
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25» (canceled). 



26, (canceled). 



27* (canceled). 



28. (canceled), 



29. (canceled). 



30. (canceled). 



31* (canceled). 



32. (canceled). 
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33. (original) One or more computer-readable media, comprising stored 
thereon: 

a first set of elements to describe a server in communication through a connection 
of a packet switched network to a client; 

a second set of elements to describe the transmission of a mixed media data 
stream, including audio and multiple video objects (MVOs), from the server to the client 
through a connection over a packet switched network; and 
a code segment that^ when executed: 

monitors transmission characteristics of the connection between server and 
receiver; 

estimates available bandwidth at the sender based upon the monitored 
transmission characteristics of the connection; 

allocates a global buffer for the mixed media data stream to be transmitted 
stream from the sender to the receiver as a function of the estimated available 
bandwidth at the sender; 

pre-encodes a portion of each Video Object Plane (VOP) in the global 
buffer with respect to a quantization parameter (QP) of the VOP; 

encodes the VOP in the global buffer based on the QP; 

updates a rate distortion model based upon the QP and packet loss rate; 

performs a frame skipping function after the VOP encoding; and 

transmits from the sender to the receiver the encoded video object plane in 
Ae global buffer at a regulated sender transmission rate from the sender as a 
function of the estimated available bandwidth at the sender. 
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34. (origiBal) One or more computer-readable media, comprising stored 
thereon; 

a first set of elements to describe a server in communication througji a connection 
of a packet switched network to a client; 

a second set of elements to describe the transmission of a mixed media data 
stream, including audio and multiple video objects (MVOs), from the server to the client 
through a connection over a packet switched network; and 
a code segment that, when executed: 

monitors transmission characteristics of one or more encoded video object 
planes through the connection between the sender and the receiver; 

estimates, from the transmission characteristics, an available bandwidth 
(Rj) at the sender; 

allocates, as a function of the Rt, a portion of the mixed media data stream 
to a global buffer, 

encodes a video object pane from the global buffer based upon a rate 
distortion function that accounts for packet loss rate between sender and receiver; 

updates the rate distortion function based upon results of the encoded 
video object plane and upon a memory containing results of one or more 
previously encoded video object panes; 

after the encoding the MVOs in the video object plane, performs a frame 
skipping function; and 

transmits, at the estimated available bandwidth, the encoded video object 
plane from the sender to the receiver. 
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